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Abstract. We extend our approach to abstract syntax (with binding 
constructions) through modules and linearity. First we give a new gen- 
eral definition of arity, yielding the companion notion of signature. Then 
we obtain a modularity result as requested by |GU03] : in our setting, 
merging two extensions of syntax corresponds to building an amalga- 
mated sum. Finally we define a natural notion of equation concerning a 
signature and prove the existence of an initial semantics for a so-called 
representable signature equipped with a set of equations. 



1. Introduction 

1.1. Modules for modular higher-order syntax and semantics. Many 
programming or logical languages allow constructions which bind variables 
and this higher-order feature causes much trouble in the formulation, the 
understanding and the formalization of the theory of these languages. For 
instance, there is no universally accepted discipline for such formalizations: 
that is precisely why the POPLmark Challenge [ABF + 05] offers benchmarks 
for testing old and new approaches. Although this problem may ultimately 
concern typed languages and their operational semantics, it already con- 
cerns untyped languages equipped with an equational semantics. Indeed, 
even at the informal level, there is not yet a universally adopted notion of 
higher-order theory. 

The goal of this work is to extend, in particular towards equational se- 
mantics, our approach to higher-order abstract syntax [HM07], based on 
modules and linearity. First of all, we give a new general definition of arity, 
yielding the companion notion of signature. The notion is coined in such 
a way to induce a companion notion of representation of an arity (or of a 
signature) in a monad: such a representation is a morphism among modules 
over the given monad, so that an arity simply assigns two modules to each 
monad. Then we explain how our approach enjoys modularity in the sense 
introduced by [GU03J: in our view, a syntax is or yields a monad equipped 
with some module morphisms; such enriched monads form a category in 
which merging two extensions of syntax corresponds to building an amal- 
gamated sum. Finally, we define a general notion of equation for a given 
signature (or syntax) E and we prove the corresponding theorem for initial 
semantics. As for arities, our notion of equation is coined in such a way to 
induce the notion of whether the equation is satisfied by an arbitrary repre- 
sentation of E in a monad R: this will be when two morphisms of modules 
over R coincide. Accordingly an equation assigns to each representation of 
E a pair of morphisms of modules (with common domain and codomain) . 
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1.2. Examples. Such a proposal should definitely offer a convincing picture 
concerning the paradigmatic example of the lambda-calculus. In our previ- 
ous work [HM07J we treated the examples of the untyped lambda-calculus 
modulo a-equivalence and a/^-equivalence. In section[6]we revisit these two 
examples. We then give various other examples obtained by adding features 
to the lambda-calculus: differentiation, parallelism, explicit substitution. 

1.3. Future work. In the present work we give a notion of untyped higher- 
order theory, and we observe the existence of an initial representation for 
algebraic signatures. This has to be extended to more general signatures, 
including the signature of the lambda-calculus with explicit substitution, as 
pioneered in [GU03] . in order to reach a satisfactory state for the untyped 
equational setting. The point of view proposed here will also be accommo- 
dated to deal with languages with a fixed set of types (for an example see 
[Zsi06| ). or to model operational semantics through monads on the cate- 
gory of preordered sets, or both. It should also be extended to the case of 
dependent types. 

1.4. Organization of the paper. Section [5] gives a succinct account about 
modules over a monad. Our new definitions of (higher-order) arity and 
signature are given in section O We propose a solution to the problem of 
modularity in section [H Section [5] develops the theory of equations for our 
notion of syntax and contains our theorem about initial semantics. Section 
[6] treats some explicit examples. The last section discusses related works. 

2. Modules over Monads 

We recall only the definition and some basic facts about (right) modules 
over a monad. See |HM07j for a more extensive introduction on this topic. 

Let C be a category. A monad over C is a monoid in the category C — » C 
of endofunctors of C, i.e., a triple R = (R, fi, rj) given by a functor R: C — > C, 
and two natural transformations fi: R 2 — > R and 77: I — > R such that the 
following diagrams commute: 




Let R be a monad over C. 

Definition 2.1 (Right modules). A right R- module is given by a functor 
M : C — > D equipped with a natural transformation p: M ■ R —* M, called 
action, which is compatible with the monad composition and identity: 

Ma Mrt 

M ■ R 2 »- M ■ R M R ■* M ■ I 




We will refer to the category D as the range of M. 
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We say that a natural transformation of right i?-modules r: M — > N is 
linear if it is compatible with action: 



Pm 



Pn 



M >■ N 

We take linear natural transformations as morphisms among right modules 
having the same range D. It can be easily verified that we obtain in this 
way a category that we denote Mod D (i?). 

There is an obvious corresponding definition of left i?-modules that we do 
not need to consider in this paper. From now on, we will write -R-modules 
instead of right i?-modules for brevity. 

Example 2.2. Let us show some trivial examples of modules: 

(1) Every monad R is a module over itself, which we call the tautological 
module. 

(2) For any functor F: D — > E and any i?-module M : C — > D, the 
composition F ■ M is a i?-module (in the evident way). 

(3) For every object W G D we denote by W: C — > D the constant 
functor W := X i-> W . Then W is trivially a i?-module since W = 
W • R. 

Limits and colimits in the category of right modules can be constructed 
point-wise. For instance: 

Lemma 2.3 (Limits and colimits of modules). If D is complete (resp. co- 
complete), then Mod D (i?) is complete (resp. cocomplete) . 

In particular, we will often make use of the fact that, if the range category 
D is cartesian, then the category Mod D (i?) is also cartesian. 

For our purposes, one important example of module is given by the fol- 
lowing general construction. Let C be a category with finite colimits and a 
final object *. 

Definition 2.4 (Derivation). For any i?-module M with range D, the deriv- 
ative of M is the functor M:=Ih» M(X + *). Derivation can be iterated, 
we denote by the k-th derivative of M. 

Proposition 2.5. Derivation yields an endofunctor of Mod D (i£). More- 
over, if D is a cartesian category, derivation is a cartesian endofunctor of 
Mod ^). 

In the case C = D = Set, the functor M' is given by M' := X h-> M(X+*), 
where X+* denotes the set obtained by adding a new point to X. Moreover, 
we have a natural evaluation morphism 

eval: M' x R — ► M. 

which is i?-linear. This allows us to interpret the derivative M' as the 
"module M with one formal parameter added". Higher-order derivatives 
have analogous morphisms (that we still denote with eval) 

eval : M (6) x R b — ► M. 
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where eval(i, mi, . . . , ntf,) G M(X) is obtained by substituting mi, . . . , m^ G 

R(X) in the successive stars of t G M^(X) = M(X + * H h *). 

We already introduced the category Mod D (i?) of modules with fixed base 
R and range D. It it often useful to consider a larger category which collects 
modules with different bases. To this end, we need first to introduce the 
notion of pull-back. 

Definition 2.6 (Pull-back). Let /: R — > S be a morphism of monads and 
M a 5*-module. The action 

M -R^l M -S M 

defines a i?-module which is called pull-back of M along / and noted /*M. 
It can be easily verified that a S'-linear natural transformation g: M — > 
A" is also a i?-linear natural transformation /*<?: /*M — > /*JV and that 
/* : Mod D (S') -> Mod D ( J R) is a functor. 

It can be easily verified that pull-back is well-behaved with respect to 
many important constructions. In particular: 

Proposition 2.7. Pull-back commutes with products and with derivation. 

Definition 2.8. Given a list of non negative integers (a) = (ai, . . . , a n ) we 
denote by M( a ) = M { - ai '-' a ^ the module ilf( ai ) x • • • x M {an \ Observe that, 
when (a) = () is the empty list, we have M® = * the final module. 

Definition 2.9 (The large module category). We define the large module 
category LMod as follows: 

• its objects are pairs (R, M) of a monad R and a i?-module M. 

• a morphism from (R, M) to (S, N) is a pair (/, m) where / : R — ► S 
is a morphism of monads, and m: M — * f*N is a morphism of R- 
modules. The category LMod comes equipped with a forgetful functor 
to the category of monads, given by the projection (R, M) i— > R. 

3. Half-arities and signatures 

In this section, we improve our approach to higher-order syntax [HM07] , 
and give a new notion of arity. The destiny of an arity is to have repre- 
sentations in monads. A representation of an arity a in a monad R will 
be a morphism between two modules dom(a, R) and codom(a, R). For in- 
stance, in the case of the arity a of app 2 , we have dom(a, R) := R 2 and 
codom(a, R) := R. Hence an arity consists of two halves, each of which 
assigns to each monad R a module over R in a functorial way. 

Definition 3.1 (Arity). A half- arity is a right-inverse functor to the pro- 
jection from the category LMod to the category Mon of monads. An arity 
is a pair of two half-arities. The arity (a, b) is denoted a — * b; a and b are 
called respectively the domain and the codomain of a — > b. 

Example 3.2. (1) The assignment R R is a half- arity which we denote 
by6. 

(2) The assignment R i— > *, where * denotes the final module over R is 
a half-arity which we denote by *. 
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(3) Given a half-arity a, for each non-negative integer n, the assignment 

is a half-arity which we denote by a^ n \ As usual, we 
also set a' : = and a" := a^ 2 ). 

(4) Given two half-arities a and b, the assignment i? i— » a(i?) x is a 
half-arity which we denote by a x 6 . 

(5) For each non-negative integer n, the assignment -R i— > R n is a half- 
arity which we denote by n . 

(6) For each sequence of non-negative integers s, the assignment R h- > 

is a half-arity which we denote by G^ s \ 

(7) The assignment R i— > i? • i? is a half-arity which we denote by 0-0. 
Of course we have plenty of such composite half-arities. 

We denote by Ar the set of arities. 

Definition 3.3 (Algebraic and raw arities). Half-arities of the form 
and arities of the form 0^ — > 0W are said algebraic. An arity of the form 
H — > is said raw. 

These algebraic arities are slightly more general than those in [FPT99], 
which are precisely algebraic raw arities. In particular we have an algebraic 
arity (0 — > 0') for the app x construction given in section [6~21 

Definition 3.4 (Signatures). We define a signature E = (0,a) to be a 
family of arities a: O — > Ar. A signature is said to be raw (resp. algebraic) 
if it consists of raw (resp. algebraic) arities. 

Definition 3.5 (Representation of an arity, of a signature). Given a monad 
R over Set, we define a representation of the arity a in R to be a module 
morphism from dom(a, R) to codom(a, R); a representation of a signature 
S in R consists of a representation in R for each arity in S. 

Example 3.6. The usual app: LC 2 — > LC (see section l6T3j) is a representation 
of 2 — > into LC. A representation of * — > 0" in LC is given by the app 
construction (app (X) := app(var(*x+*), var(*x)))- 

Definition 3.7 (The category of representations). Given a signature E = 
(0,a), we build the category Mon s of representations of S as follows. Its 
objects are monads equipped with representations of S. A morphism from 
(M, r) to (N, s) is a morphism from M to N compatible with the represen- 
tations in the sense that, for each o in O, the following diagram commutes: 

dom(a(o),M) > codom(a(o), M) 

W 1 

/*dom(a(o),7V) ► /* codom(a(o), iV) 

where the horizontal arrows come from the representations and the vertical 
arrows come from the functoriality of half-arities. 

Proposition 3.8. These morphisms, together with the obvious composition, 
turn Mon s into a category which comes equipped with a forgetful functor to 
the category of monads. 

Definition 3.9. A signature E is said representable if the category Mon s 
has an initial object. 
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Theorem 3.10. Algebraic signatures are representable. 

For more details we refer to our paper [HM07] (theorems 1 and 2). 

Remark 3.11. There is a slightly more general notion of arity and signature. 
Roughly speaking, a E-arity will be a pair of E-modules (see below section 5). 
Such a E-arity may be added to E, yielding a bigger signature. This picture 
allows to consider partially defined constructions, like the predecessor. We 
leave this extension for future work. 

4. Modularity 

It has been stressed |GU03| that the standard approach (via algebras) 
to higher-order syntax lacks modularity. In the present section we show in 
which sense our approach via modules enjoys modularity. 

Suppose that we have a signature E = (O, a) and two subsignatures E' 
and E" covering E in the obvious sense, and let Eo be the intersection of E' 
and E". Suppose that these four signatures are representable (for instance 
because E is algebraic). Modularity would mean that the corresponding 
diagram of monads 

E -E' 

E" -E 

is cocartesian. The observation of [GU03| is that the diagram of raw monads 
is, in general, not cocartesian. Since we do not want to change the monads, 
in order to claim for modularity, we will have to consider a category of 
enriched monads. Here by enriched monad, we mean a monad equipped 
with some additional structure. 

Our solution to this problem goes through the following category WRep: 

• An object of WRep is a triple (R, E, r) where R is a monad, E a signature, 
and r is a representation of E in R. 

• A morphism in WRep from (R,(0,a),r) to {R' , (0' ,a'),r') consists of 
a map i := O — > O' compatible with a and a' and a morphism m from 
(R,r) to (R',i*(r f )), where, for i injective, i*{r') should be understood 
as the restriction of the representation r' to the subsignature (O, a). 

• It is easily checked that the obvious composition turns WRep into a 
category. 

Now for each signature E, we have an obvious functor from Mon s to WRep, 
through which we may see E as an object in WRep. Furthermore, an in- 
jection i: Ei — > E2 obviously yields a morphism i* := Ei — > E2 in WRep. 
Hence our 'cocartesian' square of signatures as described above yields a 
square in WRep. The proof of the following statement is straightforward. 

Proposition 4.1. Modularity holds in WRep, in the sense that given a 
'cocartesian' square of signatures as described above, the associated square 
in WRep is cocartesian again. 
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There is a stronger statement in a category Rep with the same objects 
and more morphisms. Roughly speaking, in Rep, a morphism from (R, £, r) 
to (R', £', r') is a compatible pair of a monad morphism and a "vertical" 
functor from MonP to More s . We plan to describe this more carefully in 
some future work. 

5. The Category of Half-Equations 

In this section, we are given a signature £, and we build the category 
where our equations will live. 

Definition 5.1 (The category of half-equations). We define a E-module U 
to be a functor from the category of representations of £ to the category 
LMod commuting with the forgetful functors to the category Mon of monads. 

Mon s »■ LMod 




Mon 



We define a morphism of E-modules to be a natural transformation which 
becomes the identity when composed with the forgetful functor. We call 
these morphisms "half-equations". 

These definitions yield a category which we call the category of E-modules 
or half-equations. 

Example 5.2. To each half-arity a is associated, by composition with the 
projection from Mon s to Mon, a S-module still denoted a. In particular 
we have a S-module 0. Accordingly, to each construction c € £ with arity 
a — > b is associated in the obvious way a morphism of E-modules, still 
denoted c, from a to b. 

Example 5.3. Since derivation is a "vertical" endofunctor in LMod, it acts 
on E-modules. In particular we also have a family of E-modules 0( n ). 

Proposition 5.4. The category of half- equations is cartesian. 

Example 5.5. To each application /: [1, . . . ,p] — > [1, . . . ,q] is associated a 
half-equation: /*: — ► (which we call renaming along /). 

Definition 5.6 (Equations). We define an equation for E to be a pair of 
half-equations with common source and target. We also write e\ = e2 for 
the equation (ei,e2). 

Example 5.7. In case E consists of the two constructions abs and app 1 
(cfr. section [6^2]) with respective arities 0' — > and — > 0', the j3 equation 
is app 1 • abs = Ide/, while the r\ equation is abs • app 1 = Ide- 

Definition 5.8 (Satisfying equations). We say that a representation r of E 
in a monad M satisfies the equation e\ = e% if e\{r) = e2{r). If E is a set of 
equations for E, we say that a representation r of E in a monad M satisfies 
E (or is a representation of (E,22)) if it satisfies each equation in E. We 
define the category of representations of (E, E) to be the full subcategory 
in the category of representations of E whose objects are representations of 
(£,£). 
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Theorem 5.9 (Initial representation of (E, E)). Given a set E of equations 
for a representable signature E, the category of representations of(T,,E) has 
an initial object. 

Sketch. We build the monad S for our initial representation as a quotient of 
E (see theorem I3.1U|) . For each set X, we define an equivalence relation rx 
on E(X) as follows: rx(a,b) means that for any representation p of (E,!?) 
in a monad M, ix{o) equals ix(b), where i: E — > M is the initial functor 
associated to p. We check easily that this is an equivalence relation, that 
the corresponding collection of quotients inherits the structure of monad, 
and that this quotient monad has the required universal property. □ 

6. Examples 

We now illustrate the previous notions through some well-known exam- 
ples. 

6.1. Monoids. We first consider an example of first-order syntax with equa- 
tions. Given a set X, let us denote by M(X) the free monoid built over X. 
This is a classical example of monad over the category of (small) sets. The 
monoid structure gives us, for each set X, two maps mx '■ M(X) x M(X) —* 
M{X) and ex '■ * — ► M(X) given by the product and the identity respec- 
tively. It can be easily verified that m: M 2 — ► M and e: * — > M are 
M-linear natural transformations. In other words (M, p) = (M, {m, e}) 
constitutes a representation of the signature E = {m: 2 — ► 0, e: * — > 0}. 

In the category Mon s of representations of E we consider the associativity 
equation, i.e., the pair of half-equations given by 

_ 0xm m _ 
3 ^ 2 ^ @ 

3 -z— »■ 2 ^tt^ 

Analogously, we define the left and right identity equations given by the 
morphisms 

9 2 9- and ^ 9 2 ^ 

= ^0 ^0 

and we denote by E the system constituted by these three equations. 

The category Mon^'^ is the category of monads with a structure of 
monoid and (M, p) is its initial object. 

6.2. Lambda-calculus modulo a-equivalence. We denote by A(X) the 
set of lambda-terms up to a-equivalence with free variables "indexed" by the 
set X. It is well-known [BP99bt lA~R99l IHM07] that A has a natural structure 
of monad where the monad composition is given by variable substitution. 

It can be easily verified ( |HM07j ) that application and abstraction are 
A-linear natural transformations 

app := A 2 — ► A, abs := A' — * A. 

that is, A is a monad endowed with a representation p of the signature 
E = {app: 2 -» 0,abs: 0' -» 0}. 
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Again, the monad A is initial in the category Mon s of monads endowed 
representations of the signature E. 

For our purposes, it is important to introduce another interesting, non- 
raw, representation on A which is defined as follows. Consider the A-module 
morphism 

app x : A — > A' 

given by app 1 (x) = app(x, *). Then app 1 is a representation of arity — > 0' 
and the usual app constructor can be recovered from app x by flattening, i.e., 

3pp(x,y) = eva I (appear),?/). 

Then we can consider on A the representation p' = {app 1 ,abs} of signature 
E' = {app : : -> 0',abs: 0' -> 0}. The categories Mon s ' and Mon s 
are equivalent through the flattening and (A, p') is the initial object of the 
category Mon . 

6.3. Lambda-calculus modulo a/3r/-equivalence. Now we can introduce 
the lambda-calculus modulo a/3?7-equivalence as a quotient of the previ- 
ous calculus. We denote by LC(X) the set of lambda-terms up to aflrj- 
equivalence with free variables "indexed" by the set X. As in the previous 
example, the monad LC is endowed with a representation p and p' of the 
two signatures E = {app: 2 — > 0,abs: 0' — » 0} and E' = {app^ — ► 
0',absi0' — > 0} respectively. Now we want to introduce the equations for 
the (5 and 77 equivalence relations. This can be done both with p and p', but 
it looks more natural when it is formulated with respect to p' . 

We define the (5 and r\ equivalence relation as the pair of half-equations 
on Mon given by 

e'^0^-0' and e^e'^e 

0' 0' = 

respectively. We denote by E the system constituted by the (5 and 77 equa- 
tions. It can be shown that (LC,//) is initial in the category Mon 1 - 2 
(this has been proved formally in the Coq proof assistant and discussed in 
[HM07Q . 

6.4. HOcore. HOcore is a higher-order calculus for concurrency introduced 
by Lanese, Perez, Sangiorgi and Schmitt [LPSS08]. The syntax of HOcore 
is as follows 

P ::= x I a{x).P \ a.(P) \ P \\ P \ 

where a ranges over the sort of names (or channels) and x denote a process 
variable. In the input prefix process a{x).P the variable x is bound in the 
body P. In our framework the HOcore syntax is represented by the signature 

EHOcore = { Vo. recv a : 0' 0, Va. send a : -> 0, 
parallel: O 2 — ► 0, zero: * — > } 

where recv and send are families of constructors parametrized over the names 
a. Let us denote by HOcore the monad Enocore- 
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To spell out a concrete example, consider a pair of concurrent processes 
where the first process sends a message P through the channel a to the 
second process: 

a(P) || a(x).Q 

In our formalism such process is represented by the syntax tree 

parallel(send a P, recv a Q) 

where P G HOcore(X) and Q £ HOcore(AT+*) for some set of name variables 
X. Now consider the reduction rule 

a{P) || a(x).Q = || Q[x := P] 

which models the exchange of a message P through a channel a between two 
concurrent processes. This can be stated as the equality of the two linear 
morphisms of kind HOcore x HOcore' — > HOcore given by 

(P,Q) h-> parallel(send a P, recv a Q) 
(P,Q) ■-> parallel(zero,eval(Q,P)) 

Once abstracted over the representation p, the previous pair of morphisms 
gives a pair of half-equations on the category Mon SHOcore . 



6.5. Lambda calculus with explicit substitution. We now consider an 
example of non algebraic signature. On the monad A(X) of lambda calculus 
(modulo a-equivalence) given in 16.21 the substitution operator 

subst: A • A — ► A 

given by the monad composition (or join) is a representation of the arity 
O-O^O (0-0 has a natural structure of module thanks to 12.21 (2)). We 
then have a representation p of the signature 

£:={ app:0 2 ^0, abs: 8' -> 0, subst: 0-0^0 }. 

In the monad A, substitution interacts with the app and abs constructors in 
the following way. Let us denote by subst' : • 0' = (0 • 0)' — > 0' the linear 
transformation induced by subst. Given any monad P we have a natural 
transformation swap^: P(X) + * — ► P(X + *). Then (A,/?) satisfies the 
system E constituted by the two equations 

a PP"@ subst 

0-0x0-0 ^0-0 * 



0-0x0-0— ^6x6—^6 

substxsubst a PP 



and 



e'.e ^ 0-0^0 

0' • ~ — *- • 0' — — ■*■ 0' — r-*- 

B-swap subst abs 

We call Mon s the category of lambda-calculi with explicit substitution. We 
claim that (A, p) is its initial object in Mon*- 2 '^. 
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6.6. Lambda-calculus with explicit differentiation. Inspired by [ER03J 
we sketch the definition of what we call Lambda- calculus with explicit differ- 
entiation (LCED). The syntax of LCED is given by the signature 

Slced:={ app:9 2 ^9, abs: 9' — > 0, 0:*^9, + :9 2 ^9, 
partial : 0' x 6 -» 9', V/c G N*. diff fc : 9 2 -> 9 }. 

We use the notations dt ■ u for partia I (ti, t) (the "linear" substitution — in 
the sense of [ER03] — of u for the first variable in t) and D^t-u for difffc (t, u) 
(the differential of t with respect to the k-th variable applied to u). 

The link between differentiation and linear substitution is essentially given 
by the rule 

D\ (a bs t ) • u = a bs (dt ■ u) 

The explicit linear substitution has its set of associated rules. E.g., for the 
substitution of an application we have 

<9(app(s, t)) ■ u = app(3s • u, t) + app(Z?is • (dt ■ u),t). 

We omit the complete set of rules of the calculus which will be treated in 
a future work. 

7. Related Works 

The idea that the notion of monad is suited for modelling substitution 
concerning syntax (and semantics) has been retained by many recent con- 
tributions concerned with syntax (see e.g. [BP99al fGU031 IMU04] ) although 
some other settings have been considered. Notably in [FPT99] the authors 
work within a setting roughly based on operads (although they do not write 
this word down). Gur main specificity here is the systematic use of the 
observation that the natural transformations we deal with are linear with 
respect to natural structures of module (a form of linearity had already been 
observed, in the operadic setting, see |FT01j . section 4). 

The signatures we consider here are slightly more general than the signa- 
tures in [FPT99] . which allows us to give a signature to our appi. On the 
other hand, our signatures 'reduce' (by flattening) to those in [FPT99] . In 
some future work, we plan to recover signatures as in [MU04] in terms of 
modules and to extend our initial semantics to this setting. 
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